Spatially multiplexed lens for head mounted display

ABSTRACT

An optical combiner includes an off-axis spatially multiplexed lens optically coupled to receive image light and direct the image light in an eye-ward direction. The off-axis spatially multiplexed lens includes a first sub-lens multiplexed with a second sub-lens. The first sub-lens and the sub-lens are configured to direct the image light to designated eyeward-regions.

TECHNICAL FIELD

This disclosure relates generally to optics, and in particular but notexclusively, relates to optical combiners in Head Mounted Displays(“HMDs”).

BACKGROUND INFORMATION

A head mounted display (“HMD”) is a display device worn on or about thehead. HMDs usually incorporate some sort of near-to-eye optical systemto form a virtual image located somewhere in front of the viewer. Singleeye displays are referred to as monocular HMDs while dual eye displaysare referred to as binocular HMDs. Occlusion HMDs, also called immersionHMDs, project a virtual image over a black background (the projectionoptics are not see-through). See-through HMDs also project a virtualimage, but they are at the same time transparent (or semi-transparent)and the projection optics are called combiner optics, since they combinethe virtual image over the reality. Augmented reality is one aspect ofsee-through HMDs, where the virtual image is super-imposed to thereality.

HMDs have numerous practical and leisure applications. Historically, thefirst applications were found in aerospace applications, which permit apilot to see vital flight control information without taking their eyeoff the flight path (these are referred to as Helmet Mounted Displaysand are often used for rotary wing aircrafts). Heads Up Displays(“HUDs”) are usually used in non-rotary wing aircrafts such as planesand jet fighters, where the combiner is located on the windshield ratherthan on the helmet. HUDs are also used in automobiles, where the opticalcombiner can be integrated in the windshield or close to the windshield.Public safety applications include tactical displays of maps and thermalimaging. Other application fields include video games, transportation,and telecommunications. There is certain to be newfound practical andleisure applications as the technology evolves; however, many of theseapplications are limited due to the size, weight, field of view, andefficiency of conventional optical systems used to implement existingHMDs.

BRIEF DESCRIPTION OF THE DRAWINGS

Non-limiting and non-exhaustive embodiments of the invention aredescribed with reference to the following figures, wherein likereference numerals refer to like parts throughout the various viewsunless otherwise specified.

FIG. 1A depicts a top cross-section view of an example optical combinerincluding a display module, a light relay, a beam splitter, and an endreflector.

FIG. 1B illustrates a computer generated image directed into aneyeward-region of an estimated field of view of a user of an opticalcombiner.

FIG. 2A illustrates an optical combiner including an example reflectiveoff-axis spatially multiplexed lens (“OASML”) reflecting image lighttoward an eyeward-region, in accordance with an embodiment of thedisclosure.

FIG. 2B illustrates an optical combiner including a transmissive OASML,in accordance with an embodiment of the disclosure.

FIG. 2C illustrates computer generated images directed into differentdepths of the same eye-ward region by an OASML, in accordance with anembodiment of the disclosure.

FIG. 3A illustrates an optical combiner including an example reflectiveOASML reflecting portions of image light toward multipleeyeward-regions, in accordance with an embodiment of the disclosure.

FIG. 3B illustrates an optical combiner including a transmissive OASML,in accordance with an embodiment of the disclosure.

FIG. 3C illustrates computer generated images directed into differenteyeward-regions that are stitched together, in accordance with anembodiment of the disclosure.

FIG. 3D illustrates computer generated images directed into differenteyeward-regions that are not stitched together, in accordance with anembodiment of the disclosure.

FIGS. 4A-4G illustrate a conceptual process of fabricating an OASML, inaccordance with an embodiment of the disclosure.

FIG. 5 depicts a top view of a user wearing a binocular head mounteddisplay having optical combiners that include an OASML, in accordancewith an embodiment of the disclosure.

DETAILED DESCRIPTION

Embodiments of optical combiners and Head Mounted Displays (“HMDs”) thatinclude spatially multiplexed lens are described herein. In thefollowing description, numerous specific details are set forth toprovide a thorough understanding of the embodiments. One skilled in therelevant art will recognize, however, that the techniques describedherein can be practiced without one or more of the specific details, orwith other methods, components, materials, etc. In other instances,well-known structures, materials, or operations are not shown ordescribed in detail to avoid obscuring certain aspects.

Reference throughout this specification to “one embodiment” or “anembodiment” means that a particular feature, structure, orcharacteristic described in connection with the embodiment is includedin at least one embodiment of the present invention. Thus, theappearances of the phrases “in one embodiment” or “in an embodiment” invarious places throughout this specification are not necessarily allreferring to the same embodiment. Furthermore, the particular features,structures, or characteristics may be combined in any suitable manner inone or more embodiments.

FIG. 1A depicts a top cross-section view of an example optical combiner100 including a display module 105, a light relay 165, a beam splitter131, and an end reflector 183. Optical combiner 100 may be integrated ina head gear to form a head mounted display (“HMD”). Display module 105projects computer generated images (“CGI”). Display module 105 may beimplemented by a light emitting diode (“LED”) array, an organic LED(“OLED”) array, a quantum dot array, a laser scanner, or otherwise.Display module 105 may also be implemented by a light source (e.g.laser, LED, or bulb) backlighting an LCD display or a liquid crystal onsilicon (“LCOS”) panel reflecting a light source. Display module 105 maybe considered a “micro-display.” End reflector 183 may be a concavemirror.

In operation, display module 105 launches display light (which may beCGI light) along a forward path 180 toward end reflector 183. Lightrelay 165 may have a transparent structure to permit most or a largepart of the display light to pass through along forward path 180. Lightrelay 165 may be fabricated of a solid transparent material (e.g.,glass, quartz, acrylic, clear plastic, PMMA, ZEONEX—E48R, etc.) or beimplemented as a solid housing having an inner air gap through which thedisplay light passes. Light relay 165 may operate to protect the opticalpath, but may not necessarily use total internal reflection (“TIR”) toguide or confine the display light.

Along forward path 180, display light encounters beam splitter 131. Beamsplitter 131 reflects a first portion of the display light towards theexternal scene-side of optical combiner 100 and passes a second portionof the display light. Beam splitter 131 may be a 45 degree 50/50non-polarizing beam splitter, meaning it reflects 50 percent of lightand passes the other 50 percent of light. The display light passed bybeam splitter 131 continues along forward path 180 and end reflector 183reflects back the display light along a reverse path 185. The displaylight along reverse path 185 encounters beam splitter 131, whichreflects a portion of the display light along reverse path 185 toward aneye-ward side of optical combiner 100. The illustrated embodiment ofFIG. 1A allows the display light launched by display module 105 to beprojected into eye 160 of a user, which is how a computer generatedimage is directed into eyeward-region 176. In addition to directingimages into eyeward-region 176, optical combiner 100 may also allow atleast a portion of external scene light 155 to reach eye 160 (after aportion is reflected by beam splitter 131).

FIG. 1B illustrates a computer generated image directed intoeyeward-region 176 which is in an estimated field of view (“FOV”) 190 ofa user of optical combiner 100. In FIG. 1B, FOV 190 and eyeward-region176 are defined within an x-y plane. A typical user of an HMD may have anatural field of view (“FOV”) of nearly 180° horizontally. An imagepresented within eyeward-region 176 from optical combiner 100 may onlybe presented to the user in 15° (horizontally) of the user's total FOVand only within the x-y plane. In certain contexts, it would beadvantageous to present images and information to a user in differentdepths (z-axis) of FOV 190 and in more than 15° (horizontally) of theuser's total FOV.

FIG. 2A illustrates an optical system 200A that includes a displaymodule 205 and an optical combiner 230A that includes an examplereflective off-axis spatially multiplexed lens (“OASML”) 231, inaccordance with an embodiment of the disclosure. Combiner 230A may beintegrated as an eyepiece in a monocular or binocular HMD. Combiner 230Amay be generally transparent and fabricated of a solid transparentmaterial (e.g., glass, quartz, acrylic, clear plastic, PMMA,ZEONEX—E48R, etc.). The generally transparency of combiner 230A allowsexternal scene light 155 to propagate to eye 160 to allow a user to viewher environment when combiner 230A is in front of a user's eye 160.Display module 205 may be implemented by a light emitting diode (“LED”)array, an organic LED (“OLED”) array, a quantum dot array, a laserscanner, or otherwise. Display module 205 may also be implemented by alight source (e.g. laser, LED, or bulb) backlighting an LCD display or aliquid crystal on silicon (“LCOS”) panel reflecting a light source.Display module 205 may be considered a “micro-display.”

To present images to a user, display module 205 projects image light 207(that may include computer generated image(s)) toward reflective OASML231. OASML 231 includes three sub-lenses that are spatially multiplexedas OASML 231, in the illustrated embodiment. However, a spatiallymultiplexed lens may incorporate just two (or more) sub-lenses.Spatially multiplexed lenses are used in industry, for example, in theoptical disk reading contexts, to give an optical reading head theability to read both CD and DVD formats.

Each of the three sub-lenses in OASML 231 direct the image light towardeyeward-region 276. The first sub-lens in the illustrated OASML 231 hasa first focal length 241 and is configured to receive image light 207and direct a first portion of the image light 207 toward eyeward-region276. Similarly, the second sub-lens in OASML 231 has a second focallength 242 and is configured to receive image light 207 and direct asecond portion of the image light 207 toward eyeward-region 276. Thethird sub-lens in OASML 231 has a third focal length 243 and isconfigured to receive image light 207 and direct a third portion ofimage light 207 toward eyeward-region 276. The effect of choosingdifferent focal lengths (e.g. 241, 242, and 243) for each sub-lensallows optical system 200A to present three images with associated depthin the same eyeward-region 276. The focal point (illustrated as blackfilled circles) of each sub-lens may be behind eye 160 in order toproduce virtual images that a viewer's eye 160 can focus on. Thoseskilled in the art will appreciate that even though the focal points ofthe various sub-lenses are illustrated behind eye 160, the lens in eye160 will further focus images in image light 207 onto the back of theeye so they will be in focus for the user.

FIG. 2C illustrates computer generated images directed into differentdepths of the same eye-ward-region 276 by an OASML, in accordance withan embodiment of the disclosure. Eyeward-region 276 is within a user'sFOV 290. The first sub-lens of OASML 231 focuses a first color (e.g.red) of the image light 207 as a first image at a first depth 291. InFIG. 2C, the first image is illustrated as the letter “A.” The secondsub-lens of OASML 231 focuses a second color (e.g. green) of the imagelight 207 as a second image at a second depth 292. The second image isillustrated as the letter “B.” The third sub-lens of OASML 231 focuses athird color (e.g. blue) of the image light 207 as a third image at athird depth 293. The third image is illustrated as the letter “C.” Thefirst, second, and third images are focused in the same x-y coordinatesof eyeward-region 276, but they have different depths (z-axis). Thevirtual images (e.g. first, second, and third images) in image light 207may be located in the range of a few meters in front of the viewer's eye160, depending on what sub-lens is presenting the image. In one example,the first image is presented at one meter, the second image is presentedat two meters, and the third image is presented at three meters. A usermay perceive a superimposed combination of the first, second, and thirdimages, due to their different depths.

Returning to FIG. 2A, reflective OASML 231 may use a variety of lensingconfigurations. For example, OASML 231 may use purely reflectivelensing, purely diffractive lensing, or a combination of both. In apurely reflective lensing configuration, each sub-lens that ismultiplexed into OASML 231 utilizes mirror curvatures that are coatedwith a color filter that reflects a specific color (in a wavelengthrange) but substantially absorbs or passes other colors in the visiblespectrum. Dichroic filters are used to allow each sub-lens to select forcolor, in some embodiments. The mirror curvatures may be 50/50 mirrorsthat pass 50% of incident light while reflecting the other 50% ofincident light. This allows a portion of external scene light 155 toreach eye 160. The curvature of the mirrors that are multiplexedtogether define the optical power corresponding with the focal lengths241, 242, and 243, while the color filters coating the mirrors sectionsact as color selectors. In one embodiment, the first sub-lens is coatedwith a color filter that reflects red light, the second sub-lens iscoated with a color filter that reflects green light, and the thirdsub-lens is coated with a color filter that reflects blue light.

FIGS. 4A-4G illustrate a conceptual process of fabricating an exampleOASML that includes two sub-lenses having different focal lengths, thesame optical axis and the same aperture, in accordance with anembodiment of the disclosure. Although FIGS. 4A-4G illustrate spatiallymultiplexing two sub-lenses for descriptive purposes, those skilled inthe art will understand that the techniques and concepts of FIGS. 4A-4Gcould be applied to fabricate spatially multiplexed lens having three,four, or more sub-lenses multiplexed together.

FIG. 4A shows a first lens 421 and FIG. 4B shows a second lens 422.First lens 421 has a shorter focal length than second lens 422. Firstlens 421 and second lens 422 can be spatially multiplexed in a varietyof different configurations. For example, first lens 421 and second lens422 could be spatially multiplexed in a checkerboard pattern at amicroscopic level. In a checkerboard pattern multiplexing, the opticalproperties of first lens 421 are fabricated on what would be the blackspaces on the checkerboard and the optical properties of second lens 422are fabricated on what would be the white spaces on the checkerboard. Ofcourse, the checkboard pattern may include many more spaces than anactual 8×8 gaming checkerboard. In another example, first lens 421 andsecond lens 422 could be spatially multiplexed in an expanding ringpattern where the optical properties of first lens 421 are and secondlens 422 are alternately fabricated into expanding rings thatincrementally expand outward. The expanding rings pattern may take theform of a bulls-eye pattern when the rings expand as concentric circles.In addition to the checkerboard and expanding rings examples, adartboard pattern may be used for spatially multiplexing first lens 421and second lens 422. A dartboard pattern may offer advantages withregard to reducing optical artifacts compared to the checkerboard andexpanding rings patterns, as the same numerical aperture as well as theradial and angular components of each lens can be retained.

FIG. 4C shows a first lens component 441 which is a result of first lens421 having portion removed in a dartboard pattern. FIG. 4D shows asecond lens component 442, which is a result of second lens 422 havingportions removed in a dartboard pattern that will complement theportions of first lens 421 that have been removed. In other words,second lens component 442 can geometrically be “dropped in” to firstlens component 441 to form a spatially multiplexed lens. FIG. 4E showsspatially multiplexed lens 450 that includes first lens component 441combined with second lens component 442. Thus, spatially multiplexedlens 450 includes a first sub-lens (first lens component 441) and asecond sub-lens (second lens component 442) that are multiplexedtogether along a common optical axis in a dartboard pattern. FIG. 4Fshows an off-axis spatially multiplexed lens 475 which is an off-axisportion of spatially multiplexed lens 450. FIG. 4G illustrates thatOASML 475 includes a first sub-lens having first zones 481 and a secondsub-lens having second zones 482. All of the first zones 481 include theoptical characteristics of the first sub-lens and all of the secondzones 482 include the optical characteristics of the second sub-lens.

It is appreciated that FIGS. 4A-4F are a conceptual progression of thedesign process for a spatially multiplexed lens and that the off-axisspatially multiplexed lens 475 illustrated in FIG. 4F could befabricated directly by designing the appropriate lensing patterns insoftware prior to translating the pattern to a physical lens medium.Fabricating the off-axis spatially multiplexed lenses may beaccomplished using lithography, diamond turning with CNC machine-tools,press molding into negative impressions of the off-axis multiplexedlenses, or a combination of these fabrication techniques. Furtherinformation for optics fabrication techniques that can be used toproduce spatially multiplexed lenses is described in Chapters 12-14 ofApplied Digital Optics: From Micro-optics to Nanophotonics. Kress,Bernard C. and Patrick Meyrueis. Applied Digital Optics: FromMicro-optics to Nanophotonics. John Wiley & Sons, Ltd, 2009.

The zones (481, 482) of OASML 475 could be coated with the appropriatecolor filters and used as reflective OASML 231, in FIG. 2A. Although inthat case, reflective OASML 231 would only have two sub-lenses and twofocal lengths rather than the three illustrated. However, given thebenefit of this disclosure, those skilled in the art could fabricate anOASML having three sub-lenses selective to three different colors andhaving three different focal lengths, as illustrated in FIG. 2A. It isappreciated that when color filters are included in a given sub-lens,those color filters are applied to the zones that are included in thatsub-lens. For example, in FIG. 4G, first zones 481 are coated with afirst color filter if the first sub-lens includes color filter coatings.It is also appreciated that when reflective, refractive, and/ordiffractive optical properties are associated with a given sub-lens ofthis disclosure, the zones of those sub-lens includes those opticalproperties.

In addition to a purely reflective OASML 231 (with appropriate colorfilter coatings), OASML 231 may be made using a purely diffractiveconfiguration. In a purely diffractive configuration, each sub-lens inOASML 231 utilizes holographic structures to give each sub-lens colorselectivity and optical power corresponding with its focal length.

As is known in the art, holographic optics can be designed to reflectspecific wavelengths of light while passing other wavelengths of light(known as the Bragg selectivity in volume holograms, both in spectral orangular aspects). In addition, holographic optics can be designed toreflect specific wavelengths at different orders of diffraction tomanipulate the angle that the light is reflected (spectral aspect of theBragg selectivity). Reflecting the specific wavelengths at particularorders of diffraction can facilitate directing the specific wavelengthinto eye 160. To accomplish these reflections of specific wavelengths,the holographic optics are angle-tuned to a known angle and opticalfunctionality, such as a lensing or collimation functionality. In otherwords, to design holographic optics, a designer must consider thedesired light color to be reflected, the angle the desired light colorwill strike the holographic optic, and the required order of diffraction(if any) to direct the desired light color to the desired location. Inaddition to reflecting specific wavelengths, those skilled in the artunderstand that lensing functionality (with results similar torefractive lenses) can be designed into holographic optics. Holographicoptics may have the advantage over refractive/reflective/catadioptricoptics that they can have various optical functionalities depending onhow they are illuminated (e.g. angle of incidence wavelength,polarization). These unique properties are summarized in the well knowBragg selectivity of volume holograms.

Using conventional techniques that include creating interferencepatterns between a reference beam and a second beam, holograms may be“written” or “recorded” into photoactive holographic mediums such assilver-halide, photopolymer, dichromated gelatins, or otherwise. Theinterference patterns may be calculated in software before translatingthem into the holographic medium. The resulting holographic optics maybe designed to be transmissive or reflective. Holographic mediums areavailable from DuPont™ and other companies.

In a purely diffractive OASML 231 of FIG. 2A, each multiplexed sub-lenswould have their own holographic structures designed to focus (at itsfocal length) and reflect a specific color (using Bragg selectivityprinciples) of image light 207 from display module 205. The holographicstructures in each sub-lens could be tuned to focus and reflect imagelight 207 based on the specific angle of display module 205 relative toreflective OASML 231. In one embodiment, display module 205 projectsnarrow spectrums of red, green, and blue light as image light 207. Thefirst sub-lens, second sub-lens, and third sub-lens may beconfigured/tuned to only “act” on the narrow spectrums of the red,green, and blue light by reflecting the respective narrow spectrums whenreceived from the angle of display module 205.

A reflective/diffractive combination lens is possible as reflectiveOASML 231. In a reflective/diffractive combination lens, the curvaturesof mirrored portions of each sub-lens provides the optical power forfocusing, while a diffractive grating provides the color selectivity ofthe sub-lens. Of the different optical configurations of reflectiveOASML 231, the purely diffractive (hologram) configuration may have theadvantage of having the least impact on external scene light 155 becausethe hologram only “acts” on light received from a specific angle and ata certain wavelength. Hence, if image light 207 is constrained to narrowspectrums of red, green, and blue light, the holograms don't necessarily“act” on incoming external scene light 155 because it is not received atthe proper angle and wavelength, as compared to image light 207. Incontrast, a reflective solution (which includes mirroring and possiblycolor filters) will block a significant amount of incoming externalscene light 155 from reaching eye 160.

FIG. 2B illustrates an optical system 200B that includes an opticalcombiner 230B including a transmissive OASML 232, in accordance with anembodiment of the disclosure. Combiner 230B may be integrated as aneyepiece in a monocular or binocular HMD. Similarly to combiner 230A,combiner 230B may be generally transparent to allow external scene light155 to propagate to eye 160 to allow a user to view her environment whencombiner 230B is in front of a user's eye 160.

To present images to a user, display module 205 projects image light 207(that may include computer generated image(s)) toward transmissive OASML232. OASML 232 includes three sub-lenses that are spatially multiplexedas OASML 232, in the illustrated embodiment. Of course, transmissiveOASML 232 may incorporate two (or more) sub-lenses.

Each of the three sub-lenses in OASML 232 direct the image light 207toward eyeward-region 276. The first sub-lens in the illustrated OASML232 has a first focal length 241 and is configured to receive imagelight 207 and direct a first portion (e.g. red light) of the image light207 toward eyeward-region 276. Similarly, the second sub-lens in OASML232 has a second focal length 242 and is configured to receive imagelight 207 and direct a second portion (e.g. green light) of the imagelight 207 toward eyeward-region 276. The third sub-lens in OASML 232 hasa third focal length 243 and is configured to receive image light 207and direct a third portion (e.g. blue light) of image light 207 towardeyeward-region 276. The effect of choosing different focal lengths (e.g.241, 242, and 243) for each sub-lens allows optical system 200B topresent three images with associated depth in the same eyeward-region276. The focal point (illustrated as black filled circles) of eachsub-lens may be behind eye 160 in order to produce virtual images that aviewer's eye 160 can focus on. The virtual images may be located in therange of a few meters in front of the viewer's eye 160. Therefore,optical system 200B is capable of generating the “A,” “B,” and “C”images at different depths 291, 292, 293, as illustrated in FIG. 2C.

Transmissive OASML 232 may use a variety of lensing configurations. Forexample, OASML 232 may use purely refractive lensing, purely diffractivelensing, or a combination of both. In a purely refractive lensingconfiguration, each sub-lens that is multiplexed into OASML 232 hastransparent refractive zones (e.g. zones 481, 482) that are coated witha color filter that passes a specific color (in a wavelength range) butsubstantially absorbs or reflects other colors in the visible spectrum.The transparent refractive zones of each sub-lens that are multiplexedtogether define the optical power corresponding with the focal lengths241, 242, and 243, while the color filters coating the transparentrefractive zones act as color selectors. In one embodiment, the firstsub-lens is coated with a color filter that passes red light, the secondsub-lens is coated with a color filter that passes green light, and thethird sub-lens is coated with a color filter that passes blue light.

In a purely diffractive configuration of transmissive OASML 232, eachsub-lens in OASML utilizes holographic structures to give each sub-lenscolor selectivity and optical power corresponding with its focal length.In a diffractive/refractive combination configuration of transmissiveOASML 232, a refractive component of each sub-lens is used to provideoptical power, while a diffractive grating overlaying the refractivecomponent acts as a color selector.

Transmissive OASML 232 may be fabricated using the same conceptsexplained in association with reflective OASML 231 and FIGS. 4A-4F.However, instead of defining mirror curvatures of the sub-lenses toreflect image light 207 at a specific optical power, a transparentrefractive medium is defined to focus and direct image light 207 towardeyeward-region 276 in a purely refractive lensing configuration or arefractive/diffractive lensing configuration. In the purely diffractiveconfiguration of OASML 232, each sub-lens includes holographicstructures strategically placed into the appropriate zones (e.g. 481,482) that define the optical power and color selection of the particularsub-lens.

FIG. 3A illustrates an optical combiner 330A including an examplereflective OASML 331 reflecting portions of image light 207 towardmultiple eyeward-regions 375, 376, and 377, in accordance with anembodiment of the disclosure. Optical combiner 330A may be integrated asan eyepiece in a monocular or binocular HMD. Similarly to combiners 230Aand 230B, combiner 330A may be generally transparent to allow externalscene light 155 to propagate to eye 160 to allow a user to view herenvironment when combiner 330A is in front of a user's eye 160.

To present images to a user, display module 205 projects image light 207(that may include computer generated image(s)) toward reflective OASML331. OASML 331 includes three sub-lenses that are spatially multiplexedas OASML 331, in the illustrated embodiment. However, a spatiallymultiplexed lens may incorporate just two (or more) sub-lenses.

In the illustrated embodiment, each of the three sub-lenses in OASML 331directs a portion of image light 207 toward its correspondingeyeward-region. The first sub-lens in the illustrated OASML 331 isconfigured to receive image light 207 and direct a first portion (e.g.red light) of the image light 207 toward eyeward-region 375. Similarly,the second sub-lens in OASML 331 is configured to receive image light207 and direct a second portion (e.g. green light) of the image light207 toward eyeward-region 376. The third sub-lens in OASML 331 isconfigured to receive image light 207 and direct a third portion (e.g.blue light) of image light 207 toward eyeward-region 377. Each of thefirst, second, and third sub-lenses has a different amount of off-axisso that, for example, the red light of image light 207 is directed toeyeward-region 375, the green light of image light 207 is directed toeyeward-region 376, and the blue light of image light 207 is directed toeyeward-region 377.

In the illustrated embodiment, the first, second, and third sub-lensesare configured to substantially collimate their portion of image light207 so that a user is able to focus on the images presented in eacheyeward-region 375, 376, and 377. In one embodiment, the virtual imagesdirected to each eyeward-region are located in the range of a few metersin front of the viewer's eye 160. In one embodiment, each of the first,second, and third sub-lenses are configured to substantially collimatetheir portion of image light 207 so that each image is perceived to beat approximately optical infinity. In that regard, each of the first,second, and third sub-lenses may have the same focal length. However, insome embodiments, the focal length of each sub-lens may differ topresent the image in the eyeward-regions at different perceiveddistances from eye 160.

Reflective OASML 331 may use a variety of lensing configurations. Forexample, OASML 331 may use purely reflective lensing, purely diffractivelensing, or a combination of both. In a purely reflective lensingconfiguration, mirror curvatures define each sub-lens that ismultiplexed into OASML 331 in zones (e.g. zones 481, 482) that are alsocoated with a color filter that reflects a specific color (in awavelength range) but substantially absorbs or passes other colors inthe visible spectrum. The mirror curvatures (in the zones of eachsub-lens) also define the reflective optical power to focus (e.g.collimate) its portion of image light 207 for a user to view. In oneembodiment, the first sub-lens is coated with a color filter thatreflects red light, the second sub-lens is coated with a color filterthat reflects green light, and the third sub-lens is coated with a colorfilter that reflects blue light. The mirror curvatures in a purelyreflective lensing configuration may be 50/50 mirrors that pass 50% ofincident light while reflecting the other 50% of incident light. Thisallows a portion of external scene light 155 to reach eye 160.

In a purely diffractive configuration of reflective OASML 331, eachsub-lens in OASML utilizes holographic structures to give each sub-lenscolor selectivity and optical power to focus (e.g. collimate) itsportion of image light 207 for a user to view. In adiffractive/reflective combination configuration of reflective OASML331, a reflective component of each sub-lens is used to provide opticalpower, while a diffractive grating overlaying the reflective componentacts as a color selector.

FIG. 3B illustrates an optical combiner 330B including a transmissiveOASML 332, in accordance with an embodiment of the disclosure. Combiner330B may be integrated as an eyepiece in a monocular or binocular HMD.Similarly to combiners 230A, 230B, and 330A, combiner 330B may begenerally transparent to allow external scene light 155 to propagate toeye 160 to allow a user to view her environment when combiner 330B is infront of a user's eye 160.

OASML 332 is similar to OASML 331 except that it works in transmissionrather than reflection. To present images to a user, display module 205projects image light 207 (that may include computer generated image(s))toward transmissive OASML 332. OASML 332 includes three sub-lenses thatare spatially multiplexed as OASML 332, in the illustrated embodiment.

Each of the three sub-lenses in OASML 332 directs the image light 207 inan eyeward direction. The first sub-lens in the illustrated OASML 332 isconfigured to receive image light 207 and direct a first portion (e.g.red light) of the image light 207 toward eyeward-region 375. Similarly,the second sub-lens in OASML 332 is configured to receive image light207 and direct a second portion (e.g. green light) of the image light207 toward eyeward-region 376. The third sub-lens in OASML 332 isconfigured to receive image light 207 and direct a third portion (e.g.blue light) of image light 207 toward eyeward-region 377. Each of thefirst, second, and third sub-lenses has a different amount of off-axisso that, for example, the red light of image light 207 is directed toeyeward-region 375, the green light of image light 207 is directed toeyeward-region 376, and the blue light of image light 207 is directed toeyeward-region 377.

Transmissive OASML 332 may use a variety of lensing configurations. Forexample, OASML 332 may use purely refractive lensing, purely diffractivelensing, or a combination of both. In a purely refractive lensingconfiguration, each sub-lens that is multiplexed into OASML 332 hastransparent refractive zones (e.g. zones 481, 482) that are coated witha color filter that passes a specific color (in a wavelength range) butsubstantially absorbs or reflects other colors in the visible spectrum.The transparent refractive zones of each sub-lens that are multiplexedtogether define the optical power to focus (e.g. collimate) its portionof image light 207 for a user to view, while the color filters coatingthe transparent refractive zones act as color selectors. In oneembodiment, the first sub-lens is coated with a color filter that passesred light, the second sub-lens is coated with a color filter that passesgreen light, and the third sub-lens is coated with a color filter thatpasses blue light.

In a purely diffractive configuration of transmissive OASML 332, eachsub-lens in OASML utilizes holographic structures to give each sub-lenscolor selectivity and optical power to focus (e.g. collimate) itsportion of image light 207 for a user to view. In adiffractive/refractive combination configuration of transmissive OASML332, a refractive component of each sub-lens is used to provide opticalpower, while a diffractive grating overlaying the refractive componentacts as a color selector.

Reflective OASML 331 and transmissive OASML 332 may be fabricated usingthe same concepts explained in association with OASML 231 and FIGS.4A-4F. However, the optical properties described in association withOASML 331 or OASML 332 would replace the optical properties of OASML231.

Of the different optical configurations of reflective OASML 331 andtransmissive OASML 332, the purely diffractive (hologram) configurationsmay have the advantage of having the least impact on external scenelight 155 because the hologram only “acts” on light received from aspecific angle and at a certain wavelength. Hence, if image light 207 isconstrained to narrow spectrums of red, green, and blue light, theholograms don't necessarily “act” on incoming external scene light 155because it is not received at the proper angle and wavelength, ascompared to image light 207. In contrast, a reflective solution (whichincludes mirroring and possibly color filters) will block a significantamount of incoming external scene light 155 from reaching eye 160.

FIG. 3C illustrates computer generated images directed into differenteyeward-regions 375, 376, and 377 that are stitched together, inaccordance with an embodiment of the disclosure. Eyeward-regions 375,376, and 377 are within a user's FOV 390. The first sub-lens of OASML331/332 directs a first portion (e.g. red light) of the image light 207to first eyeward-region 375. In FIG. 3C, the first image ineyeward-region 375 is illustrated as an envelope. The second sub-lens ofOASML 331/332 directs a second portion (e.g. green light) of the imagelight 207 to second eyeward-region 376. The second image ineyeward-region 376 is illustrated as a monthly calendar. The thirdsub-lens of OASML 331/332 directs a third portion (e.g. blue light) ofthe image light 207 to third eyeward-region 377. The third image ineyeward-region 377 is illustrated as the word “SOCIAL.” To render thefirst image in red, the second image in green, and the fourth image inblue, the display module 205 may embed the first image, the second,image, and the third image in red/green/blue components of an integratedimage generated by display module 205. Alternatively, display module 205could time-multiplex red, green, and blue components of image light 207at a refresh rate (e.g. 120 Hz) that is imperceptible to eye 160.

The first, second, and third images are stitched together as acontiguous image having a 45° FOV, which increases the 15° FOVillustrated in FIG. 1B. Furthermore, the FOV is increased withoutnecessarily requiring an increase in the size of display module 205 orshortening the focal length of the optical combiner, which is prone tocreate a “bug eye” aesthetic because of the curvature requirements ofthe combiner lens. Instead, the amount of off-axis in each of the first,second, and third sub-lenses is designed to create the contiguous imagewith a 45° FOV. It is understood that a user's eye 160 may look straightahead to view the second image in eyeward-region 376, slightly to theleft to view eyeward-region 375, and slightly to the right to vieweyeward-region 377, in some embodiments. In the illustrated embodiment,the first, second, and third images are all at the same depth (z-axis)because their corresponding sub-lenses have the same focal length.However, it is appreciated that adjusting the focal length of the first,second, and third sub-lenses in OASML 331/332 will have correspondingchanges in the depth of image in FOV 390.

FIG. 3D illustrates computer generated images directed into differenteyeward-regions 375, 376, and 377 that are not stitched together, inaccordance with an embodiment of the disclosure. Similarly to FIG. 3C,eyeward-regions 375, 376, and 377 are within a user's FOV 390. However,in FIG. 3D the first, second, and third images are not stitched togetheras a contiguous image. However, the user's FOV is still extended fartherthan the 15° FOV illustrated in FIG. 1B. The amount of off-axis in eachof the first, second, and third sub-lenses is designed to create thenoncontiguous images, in FIG. 3D. It is appreciated that adjusting theoff-axis amount of the different sub-lenses can move the first, second,and third images within the users FOV 390, as desired. In theillustrated embodiment, the first, second, and third images are all atthe same depth (z-axis) because their corresponding sub-lenses have thesame focal length. However, it is appreciated that adjusting the focallength of the first, second, and third sub-lenses in OASML 331/332 willhave corresponding changes in the depth of image in FOV 390.

FIG. 5 depicts a top view of a user wearing a binocular head mounteddisplay 500 having optical combiners that include an OASML, inaccordance with an embodiment of the disclosure. Each optical combiner530 may be implemented with an embodiment of optical combiners 230A or330A and each OASML 532 in optical combiner 530 may be implemented withreflective OASML 231 or OASML 331. Although not illustrated, opticalcombiners 230B and 330B and corresponding transmissive OASMLs 232 and332 can be similarly implemented with the appropriate placement ofdisplay module 205, as illustrated in FIGS. 2B and 3B.

The optical combiners 530 are mounted to a frame assembly, whichincludes a nose bridge 505, left ear arm 510, and right ear arm 515.Although FIG. 5 illustrates a binocular embodiment, HMD 500 may also beimplemented as a monocular HMD. The two optical combiners 530 aresecured into an eye glass arrangement that can be worn on the head of auser. The left and right ear arms 510 and 515 rest over the user's earswhile nose bridge 505 rests over the user's nose. The frame assembly isshaped and sized to position each optical combiner 530 in front of acorresponding eye 160 of the user. Of course, other frame assemblieshaving other shapes may be used (e.g., a visor with ear arms and a nosebridge support, a single contiguous headset member, a headband, gogglestype eyewear, etc.).

The illustrated embodiment of HMD 500 is capable of displaying anaugmented reality to the user. Each optical combiner 530 permits theuser to see a real world image via external scene light 155. Left andright (binocular embodiment) image light 207 may be generated by displaymodules 205 mounted to left and right ear arms 510 and 515. Image light207 is seen by the user as a virtual image superimposed over the realworld as an augmented reality.

The above description of illustrated embodiments of the invention,including what is described in the Abstract, is not intended to beexhaustive or to limit the invention to the precise forms disclosed.While specific embodiments of, and examples for, the invention aredescribed herein for illustrative purposes, various modifications arepossible within the scope of the invention, as those skilled in therelevant art will recognize.

These modifications can be made to the invention in light of the abovedetailed description. The terms used in the following claims should notbe construed to limit the invention to the specific embodimentsdisclosed in the specification. Rather, the scope of the invention is tobe determined entirely by the following claims, which are to beconstrued in accordance with established doctrines of claiminterpretation.

What is claimed is:
 1. A Head Mounted Display (“HMD”) comprising: adisplay module to generate image light; and an optical combiner forcombining the image light with external scene light, wherein the opticalcombiner includes an off-axis spatially multiplexed lens (“OASML”)optically coupled to receive the image light and direct the image lightin an eye-ward direction, the OASML being a transmissive or reflectivelens, the OASML including: a first sub-lens having a first off-axis andhaving a first optical characteristic for light transmission orreflection, the first sub-lens being optically coupled to receive theimage light and direct at least a first portion of the image light to afirst eyeward-region; and a second sub-lens spatially multiplexed withthe first sub-lens and optically coupled to receive the image light anddirect at least a second portion of the image light to a secondeyeward-region different from the first eyeward-region, wherein thesecond sub-lens has a second off-axis different from the first off-axisand having a second optical characteristic for light transmission orreflection different from the first optical characteristic.
 2. The HMDof claim 1, wherein the OASML further includes a third sub-lensmultiplexed with the first and second sub-lenses, the third sub-lensoptically coupled to receive the image light and direct at least a thirdportion of the image light toward a third eyeward-region different fromthe first and second eyeward-regions, the third sub-lens having a thirdoff-axis different from the first off-axis and the second off-axis andhaving a third optical characteristic different from the first opticalcharacteristic and the second optical characteristic.
 3. The HMD ofclaim 1, wherein the OASML is an off-axis portion of a dartboardpatterned multiplexing of two different lenses having the same aperture,but different optical axes.
 4. The HMD of claim 1, wherein the OASML isa reflective lens, and wherein the first sub-lens is coated with a firstcolor filter that reflects a first color light of the image light towardthe first eyeward-region and the second sub-lens is coated with a secondcolor filter that reflects a second color light of the image lighttoward the second eyeward-region, the second color light different fromthe first color light.
 5. The HMD of claim 1, wherein the OASML is areflective lens, and wherein the first sub-lens includes firstdiffractive structures tuned to reflect a first color light of the imagelight toward the first eyeward-region and the second sub-lens includessecond diffractive structures tuned to reflect a second color light ofthe image light toward the second eyeward-region, the second color lightdifferent from the first color light.
 6. The HMD of claim 1, wherein theOASML is a transmissive lens, and wherein the first sub-lens is coatedwith a first color filter that transmits a first color light of theimage light toward the first eyeward-region and the second sub-lens iscoated with a second color filter that transmits a second color light ofthe image light toward the second eyeward-region, the second color lightdifferent from the first color light.
 7. The HMD of claim 1, wherein theOASML is a transmissive lens, and wherein the first sub-lens includesfirst diffractive structures tuned to pass a first color light of theimage light toward the first eyeward-region and the second sub-lensincludes second diffractive structures tuned to pass a second colorlight of the image light toward the second eyeward-region, the secondcolor light different from the first color light.
 8. The HMD of claim 1,wherein the first sub-lens has a first focal length, and wherein thesecond sub-lens has a second focal length that is different from thefirst focal length.
 9. An optical combiner to combine image light andexternal scene light for a Head Mounted Display (“HMD”), the opticalcombiner comprising: an off-axis spatially multiplexed lens (“OASML”)optically coupled to receive the image light and direct the image lightin an eye-ward direction, the OASML being a transmissive or reflectivelens, the OASML including: a first sub-lens having a first off-axis andhaving a first optical characteristic for light transmission orreflection, the first sub-lens being optically coupled to receive theimage light and direct at least a first portion of the image light to afirst eyeward-region; and a second sub-lens spatially multiplexed withthe first sub-lens and optically coupled to receive the image light anddirect at least a second portion of the image light to a secondeyeward-region different from the first eyeward-region, wherein thesecond sub-lens has a second off-axis different from the first off-axisand having a second optical characteristic for light transmission orreflection different from the first optical characteristic.
 10. Theoptical combiner of claim 9, wherein the OASML is a reflective lens, andwherein the first sub-lens includes a first hologram tuned to reflectand focus a first color light of the image light toward the firsteyeward-region and the second sub-lens includes a second hologram tunedto reflect and focus a second color light of the image light toward thesecond eyeward-region, the second color light different from the firstcolor light.
 11. The optical combiner of claim 9, wherein the firstportion of the image light is a first color of the image light, andwherein the second portion of the image light is a second color of imagelight different from the first color.
 12. The optical combiner of claim9, wherein the OASML further includes a third sub-lens multiplexed withthe first and second sub-lenses, the third sub-lens optically coupled toreceive the image light and direct at least a third portion of the imagelight toward a third eyeward-region different from the first and secondeyeward-regions, the third sub-lens having a third off-axis differentfrom the first off-axis and the second off-axis and having a thirdoptical characteristic different from the first optical characteristicand the second optical characteristic.
 13. The optical combiner of claim9, wherein the first sub-lens includes first reflective curvaturesincluding first diffractive structures that selectively reflect a firstcolor of the image light, wherein the first reflective curvatures areconfigured to reflect and collimate the first color of the image light,and wherein the second sub-lens includes second reflective curvaturesincluding second diffractive structures that selectively reflect asecond color of the image light, wherein the second reflectivecurvatures are configured to reflect and collimate the second color ofthe image light, the second color different from the first color.